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In the presence of feedback control by "Maxwell's demon," the second law of thermodynamics 
and the nonequilibrium equalities such as the Jarzynski equality need to be generalized. In this 
paper, we derive the generalized Jarzynski equalities for classical Hamiltonian dynamics based on 
the Liouville's theorem, which is the same approach as the original proof of the Jarzynski equality 
^"Y [Phys. Rev. Lett. 78, 2690 (1997)]. The obtained equalities lead to the generalizations of the second 

law of thermodynamics for the Hamiltonian systems in the presence of feedback control. 
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I. INTRODUCTION 



Due to the recent advancement of nonequilibrium statistical mechanics, it has been established that the second 

■ law of thermodynamics can be expressed not only in terms of inequalities but also in terms of equalities, such as the 
fluctuation theorem and the Jarzynski equality [lHZj]- These equalities are universally valid even if the state of the 
system is far from equilibrium. For the case of classical dynamics, the Jarzynski equality [6j is expressed as 

{e -p(W-AF) } = 1; (1) 

> ' 

where (...) describes the ensemble average for all microscopic trajectories, T — (fce/3) is the temperature of the 
initial canonical distribution with /eb being the Boltzmann constant, W is the work performed on the system, and 
AF is the free-energy difference. We note that Eq. (jTJ) holds if the initial distribution of the system is the canonical 
distribution. The usual expression of the second law of thermodynamics is a straightforward consequence of the 
' Jarzynski equality: by using the concavity of the exponential function, we obtain 

C ■ 

O AF - (W) < 0. (2) 

O 

Inequality implies that the amount of the free-energy gain of the system cannot be larger than the amount of the 
energy-input (work) on the system on average. 

However, if a thermodynamic system is subject to feedback control (or equivalently, th e sy stem is controlled by 
"Maxwell's demon" [a-tlO|). the second law of thermodynamics @ needs to be generalized [ll] - t21| . Here, "feedback" 
means that the control protocol depends on the outcomes obtained by measurements. For example, for the case of 
the Szilard engine @, the demon can extract fee? 1 In 2 of work from an isothermal cycle by using 1 bit (= In 2 nat) 
of information. The essential of the role of the demon is to increase the system's free energy with feedback control 
\ by using the information about the system. Recently, the Szilard-type Maxwell's demon has been experimentally 

■ realized by using colloidal particles [22]. 

The Jarzynski equality ^ also needs to be generalized in the presence of feedback control. In a previous work [23[, 
we have derived the generalizations of the Jarzynski equality for classical stochastic dynamics based on the detailed 
fluctuation theorem 0,111 . Moreover, several nonequilibrium equalities with feedback control have also been derived for 
different setups (24H28| , and relevant issues have been studied [29], Ho[ • We note that one of the generalized Jarzynski 



equalities has been experimentally verified 22j. However, the derivations of the generalized Jarzynski equalities based 
on the classical Hamiltonian dynamics have not been studied yet. In this paper, we will derive two generalizations of 
the Jarzynski equality based on the Hamiltonian dynamics, in particular based on the Liouville's theorem. 



II. SETUP 



We consider a (/-dimensional Hamiltonian system with N classical particles. Let x :— (r,p) be the phase-space 
point of the system, where r and p respectively denote the diV-dimensional position and momentum. We write the 
time-reversal of x as x* := (r, —p). The Hamiltonian of the system is given by H(x,X), where A denotes external 
control parameters such as the frequency of the optical tweezers. 

We consider the dynamics of the system from time t = to r. We drive the system from the thermal equilibrium 
by changing A. Let xt := x(t) and A* := A(t). The initial distribution of the system is assumed to obey the canonical 
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distribution corresponding to H(xq, Ao), whose probability density is given by 

P cw [x Q ,Xa} ■= ^ , (3) 

where Zq := J dxQe~P H ( X0:X °" > is the partition function. The corresponding free energy is Fq :— — fceTlnZo. The 
equation of motion is given by 

dr(t) dH , , . w , , 

* 9 P (4) 
^i = -_(x( t)> A(t)). 



We write the formal solution of Eq. Q as 



x t = M t [x ], (5) 



where M t is a bijective map acting on the phase space. The probability density of Xt, denoted as P[xt]) is then given 
by 

P[x t }=P caa [M t -\ Xt ),\ ], (6) 

where M t _1 is the inverse of M t , and we used the Liouville's theorem. 

We perform a measurement on the system at time t m (0 < t m < r) and obtain outcome y. We assume that the 
measurement involves a stochastic error characterized by 

P[y\x m ], (7) 

which describes the probability density of obtaining y under the condition that the true state of the system is given 
by x m := ^(*m) at time t m . If P[y|a; m ] = S(y — x m ) holds, the measurement is error-free. On the other hand, if the 
noise is Gaussian, the conditional probability is given by P[y|x m ] oc exp (—(y — x m ) 2 / (2N)^j , where N is the intensity 
of the noise. In general, the joint probability density of x m and y is given by 

P[x m ,y]=P[y\x m ]P[x m ], (8) 

and the probability density of obtaining y is given by 

P[y] - J dx m P[x ni ,y}. (9) 

We note that y* denotes time-reversal of y corresponding to the time-reversal x h- > x* . 

We then discuss the concept of the mutual information [3jJ, which is the key quantity to characterize the information 
content that is obtained by the measurement. The mutual information, denoted as (I), is defined as 

(I) := J dx^yPix^^^y (10) 

where we write 

The mutual information characterizes the correlation between state x m and outcome y; the more information we get, 
the larger (I) is. In other words, the larger the error is, the less (I) is. In fact, if two probability variables x m and y 
are independent (i.e., P[x m ,y] = P[a; m ]P[y] holds), the mutual information vanishes so that I[x m ,y] = holds for all 
x m and y. 

After the measurement at time t m , we perform feedback control on the system so that the control protocol of A 
depends on outcome y at time t (> t m ). To explicitly express the effect of the feedback, we write 

x t (y) = M t (y)[x ] (t>t m ), (12) 
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where Xt(y) is the state of the system at time t (> t m ), under the condition that the initial state is xo and the 
measurement outcome is y. Equality (|12p means that the Hamiltonian evolution of the system is determined by 
outcome y after time t m . We note that map M t (y) satisfies the Liouville's theorem for each y. 

The Hamiltonian at time r may also depend on outcome y as H(x T (y), X T (y)), where X T (y) denotes the value of 
external parameter A at time r under the condition that the outcome is given by y. The corresponding canonical 
distribution is given by 

e -PH{x T (y),K( y )) 

Pca,n[x T {y),K(y)} ■= 7tt~\ ' ( 13 ) 

Zr{y) 

where Z r (y) := J dx T {y)e~P HlyXT ^' XT ( y ^ is the partition function which gives the free energy: 

F T {y) := -k B TlnZ T (y). (14) 

We note that the probability distribution of x T (y) is not necessarily given by the canonical distribution; P[x T (y)] = 
Pca,n[x T {y), X T (y)] does not necessarily hold. 

In the total process, the work performed on the system is given by 

W := H(x T (y),X T (y)) - H(x ,X ) = H(M T (y)[x ], X T (y)) - H(x , A ), (15) 

which is determined by initial state xq and outcome y. On the other hand, the free-energy difference is given by 

AF := F T (y) - F , (16) 

which depends on outcome y. 



III. MAIN RESULTS 



We now derive the two generalizations of the Jarzynski equality. The first one is given by 

{e - Pi W-AF)-I } = ^ 

where (• • • ) describes the ensemble average with respect to xo and y. In fact, W is determined by xq and y, AF by 
y, and I by y and xo through x m = M tm [a;o]. The key feature of Eq. (jTTJ) is that the left-hand side involves the term 
of the mutual information obtained by the measurement. 

The proof of Eq. IT7|) is as follows. We first assume that P[y|a; m ] ^ holds for all y and x m . By using the joint 
distribution P[xo,y], we obtain 

(e-ttW-Af)-/) = f &ody £^±! p [y | a . ni]e -/?(H(» T ( 1 ,),A r ( 1 ,))-g(xo,Ao))^ P ^ 



Z ' z r(y) P[y\xm] ( R) 

r e -/3H(av(f).Mf)) 1 ' 

= jdx T (y)dy ^ P[y], 

where we used the Liouville's theorem dxo — dx T (y). By noting that J dx T (y)e^ ,3H< ' XT ^ v ^ XT ^ s> — Z T (y), we obtain 
Eq. (jTTJ) . We note that Eq. (jTTJ) has been obtained in Ref. [23j for classical stochastic systems. 
By using the concavity of the exponential function, we have 

/ e -P(W-AF)-Ix > e ~W(w-AF)-i) _ ^ 

Therefore, Eq. (TTT]) leads to 

(AF-W) < k B T(I), (20) 

which is the generalized second law of thermodynamics. Inequality (1201) implies that, by using feedback control, the 
free-energy increase can be lager than the performed work by the term proportional to the mutual information obtained 
by the measurement. The equality in (|20|) is achieved by the Szilard engine [3, where (AF) = 0, (W) — — A;BT'ln2, 
and (I) = In 2 hold. We note that inequality (|2"0"]) has been obtained in Ref. 15] for quantum systems and in Ref. [23[ 
for classical stochastic systems. 
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We next discuss the second generalization of the Jarzynski equality, which is given by 

{e -P(W-AF) )= ^ (21) 

where 7 characterizes the efficacy of feedback control. In fact, 7 is quantitatively defined as follows. We consider 
the backward or time-reversed process of the feedback control with outcome y. The initial state of the backward 
process is given by the canonical distribution corresponding to A T (y), and the backward control protocol is given by 
Aj (y) := A T _ t (y) for each y that is obtained in the forward process. We note that we do not perform any feedback in 
the backward process. We then perform a measurement on the system at time r — t m during the backward process, 
and obtain outcome y'. We note that y' does not necessarily equal to y* . We write as P)jy'] the probability density 

of obtaining y' by the measurement during the backward process with control protocol Aj (y) . In particular, the 
probability density of y' — y* is written as P)jy*]. Then, 7 is defined as 

7 := J ' dyP} y) [y*]. (22) 

Parameter 7 characterizes how efficiently the feedback is performed, in terms of the sum of the probabilities that the 
time-reversed outcome y* is obtained during the backward process with time-reversed protocol X t (y). We note that 
7 = 1 holds without feedback control, because {-P^[y*]} becomes a single probability distribution for such cases. On 
the other hand, 7 = 2 holds for the case the Szilard engine, where the number of the outcomes is two and the feedback 
control is perfect [23] . We note that Eq. (|21l) has been experimentally verified for a classical stochastic system [22[ • 
We now prove Eq. (|2T|) . We first obtain 

p -PH(xo,\ ) 7- 
e t~» r 1 i -B(H(x,(v).\,(i<))-H(xn.\n)) ^0 



e -P(W-A F)) = / dxQdy C p| J/ | a . m ] e -fl(ff(»r(»),Ar(»))-Jr(«0,Ao)) 



Zo ' Z T {y) 

e -PB{x T {y),K{y)) 

dx dy —— P[y\xm] (23) 

z T {y) 

r e -pH{x*(y),K{v)) 

= J dx dy YJv) 

where we assumed that the error is time-reversal symmetric as 

P[y\x m ) = P[y*\x* m ] , (24) 

and that the Hamiltonian is also time-reversed symmetric as H(x T (y), X T (y)) — H(x*(y),X T (y)). By noting that the 
Liouville's theorem dxo = dx T {y) holds for each y, and noting that dx T (y) — dx*(y) holds, we have 

{e -P(w-A F)) = J d<[y)dy P[y*\x*J. (25) 

Since the Hamiltonian dynamics is reversible, x* m — [M T ^ tin {y)]^ 1 [x^(y)] holds. Therefore, we obtain 



{e -0(w-A F)) = I d<[y)dy P[y*\[M T _ t Jy)]-\x*(y))] = I dyPfjy*] = 7, (26) 



which proves Eq. (|2"TT) . We note that Eq. (|2T|) has been derived for classical stochastic systems [23[ and for quantum 
systems [28[ . We also note that Eq. (|2"TT) is a straightforward consequence of a result in Ref. 0] for a special class of 
measurements. Equality (|2"Tj) leads to 

(AF -W) <k B Tlnj. (27) 

The equality in (|27p is achieved for the case of the Szilard engine where 7 = 2 holds. 

We now discuss the relationship between the two generalizations of the Jarzynski equality. The first one (jTTJ) 
only involves the term of the information / obtained by the measurement, which is independent of the protocol of 
the feedback control. On the other hand, the second one (|2"Tj) involves the term 7 that characterizes the efficacy 
of feedback control, which describes how efficiently the information is used by the feedback. We then discuss the 
quantitative relationship between / and 7. We introduce notation C[X] := ln(e - ^} for arbitrary probability variable 
X. We note that C[I] = holds. Then, from Eqs. ([17]) and ([21]), we obtain 

C[a + I] - C[a] - C[I] = -Inj, (28) 
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where a := j3(W — AF). If the joint probability distribution of a and 7 is Gaussian, Eq. (|28|) reduces to 

(a7)-<a)<7)=-ln 7 . (29) 

Eqs. (|28|) and ([29]) imply that 7 characterizes the correlation between u and 7; the larger 7 is, the larger the efficiency 
of decreasing a by using 7 is. 

In the conventional thermodynamics without feedback control, the free energy is not a probability variable. On 
the other hand, with feedback control, the final free energy F{y) can be a probability variable, because measurement 
outcome y is a probability variable. The free-energy difference AF defined in (fT6|) then needs to be inside the statistical 
average (• • • ) in the generalizations of the second law of thermodynamics (|20p and (f2~T|) . Therefore, the generalized 
second laws work only when we observe the ensemble of thermodynamic systems and take the ensemble average both 
in terms of phase-space point x and outcome y. This is a characteristic of thermodynamics of feedback control. If the 
control protocol is independent of outcome y, the free-energy difference also becomes independent of y and inequalities 
(I2TJ1) and (|2"T|) reduce to the conventional second law of thermodynamics. 

In conclusion, we have derived the two generalizations of the Jarzynski equality, Eqs. (IT7|) and (l2~Tj) . based on the 
Hamiltonian dynamics. The former involves the term of the obtained mutual information, and the latter involves the 
term of the feedback efficacy. The key of the present derivations is the initial canonical distribution and the Liouville's 
theorem. The equalities lead to the two generalizations of the second law of thermodynamics (f2"0"|) and (|2"T|) . which 
give the fundamental bounds of the free-energy gain of thermodynamic systems that are subject to feedback control. 
We note that our results are consistent with the second law of thermodynamics, if we take into account the energy 
cost needed for the controller during the measurement and the information erasure (32|. 
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